VSigns – A Virtual Sign Synthesis Web Tool

This paper presents a new Web tool for converting text to Sign Language notation and corresponding VRML animation sequences for H-anim compliant avatars. The tool can be used both as a sign language dictionary as well as a text to sign language translator. It is based on a Sign Language dictionary written in the well-known SignWriting system. More specifically, the entries of the dictionary are in SWML (SignWriting Markup Language), an XML-based format, which has recently been developed for the storage, indexing and processing of SignWriting notation. For sign synthesis, each sign box (basic sign) is first converted to a sequence of Body Animation Parameters (BAPs) of the MPEG-4 standard corresponding to the represented gesture. These sequences, which can also be coded and/or reproduced by MPEG-4 BAP players, are then used to animate H-anim compliant VRML avatars, reproducing the exact gestures represented in sign language notation. Envisaged applications include the development of signing avatars for interactive information systems (Web, E-mail, info–kiosks) and TV newscasts for persons with hearing disabilities.